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0 Order preserving transmission of data streams. 
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@ Data transmission in a network over two or more parallel links (link 1 . . . link n) between two network nodes 
(1 and 2). a so-called transmission group, usually requires (If the transmission protocol has no other way to solve 
the order issue) to preserve the order of the data frames within a data stream if switching from one link to the 
other occurs within a data stream, or. in other words, if a data stream is switched from one link to another. 
Two novel approaches are disclosed. 

a. The first method achieves the order preservation by numbered switch frames (4) that have to be 

exchanged between the nodes before the link switching is actually performed. 

a. In the second method, the switching is only prepared by exchanging special frames which indicate "clean" 
links. Actual switching takes place by just using an already prepared, i.e. "clean" link. 
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Field of the Invention 

In general, this invention relates to data transmission in a network and concerns particularly the 
transmission of data between two nodes within such a network. In such networks, two nodes are often 

5 connected by two or more links, be it for the reason of security, of availability or of reliability. If, in such a 
network, switching from any one link to another (between the same two nodes) occurs within one and the 
same data stream, in other words, if a data stream is switched from one link to another, it is in many 
applications imperative that the order of the data frames within said particular data stream is preserved in 
some way. If this is not achieved, the data will not be received correctly: consequently, a time consuming 

70 retransmission of the whole data stream may be necessary or. if the disorder is not detected, data may be 
corrupted. In other words, the requirement of a single link appearance of a transmisslon group, i.e. a multi- 
link connection between nodes, enforces some procedure for presen/ing the order of the frames. 

Background 

75 

The problem of order preservation in data streams when switching from one link to another in 
transmission groups has been recognized before. IBM's System., Network Architecture (SNA) is an example. 
Tutorials on the solution used in SNA are (1) J. Martin: SNA. IBM's Networking Solution, Prentice Hall, 
Englewood Cliffs, New Jersey, USA, 1987, and (2) A. Meijer: System Network Architecture, A Tutorial, 

20 PIttman Publishing, Ijondon, UK, 1987. The SNA method is to attach a sequence number to each data 
frame and reorder the frames at the receiving node according to this number. 

Though it is a rather safe method, this solution, however, has disadvantages. The numbering of each 
and every data frame occupies space and time that is lost for data, i.e. payload transmission. Further, both 
the sending and the receiving node have to keep track of the numbers given, pemnanently frame by frame, 

25 in other words, there is a substantial administration effort attributable solely to the order preservation 
requirement. 

Further, in order to rearrange potentially unordered frames in the receiver, buffering of frames must be 
provided which occupies storage resources and needs additional administrative overhead. A particular 
problem is the wrap-around necessary when the frame numbers reach the upper limit, i.e. when the 
30 maximum capacity of the order number field or section in each frame is reached. 

More details on the SNA concept are described under the heading Introduction below. 

Objects of the Invention 

35 One object of the invention is to overcome the above mentioned deficiencies of the method given in the 
prior art. 

Another object is to devise a method that, given certain conditions that the data link fulfils, achieves 
order preservation of the transmitted data frames with a minimum of "administrative" data transmission 
. between the two nodes concerned. 

40 A further object is to enable a distribution of the data to be transmitted onto selected links according to 
practically any governing rule. E.g. according to speed requirements, if links with different transmission 
speeds are used; according to security requirements in networks where the security within a transmission 
group varies; or according to economic patterns in a network with differently priced transmission links; or 
any combination of the above and other rules. 

45 Assuming that data streams can be identified, that it is sufficient to guarantee order preservation only 
for each data stream and that frame loss is tolerable, the new solution disclosed here for data streams 
groups is a very adaptive and well controllable way for sending data over transmission groups. 

Summary of the Invention 

50 

In brief, the invention concerns a new method for link switching when transmitting a data stream 
between two nodes of a network having multiple parallel links. During the transmission, data streams are 
assigned to links; the sender transmits data only over a so-called active link and the receiver accepts data 
only from an active link. 

55 To obtain the desired flexibility, the method for order-preserving shifting of the data stream from one 
link to another link the link-switching - includes a sequence of basic steps, namely 

- generating a special request in the sending node (sender), 

- attaching a sequence number to said request. 
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• transmitting said request with tts number to the receiving node (receiver) over at least one currently 
Inactive link. 

- determining whether a received request carries a higher sequence number than a request received 
before (and is thus acceptable). 

5 - if so, sending to the sender, over said currently inactive link, a special response with the sequence 
number of said received request, and 

- determining, in the sender, when receiving a response, whether its sequence number matches the 
sequence number sent with the last request and is thus acceptable, 

- depending on the result of at least one determining step, activating a so far inactive link to transmit 
70 the data stream. 

The subclaims define two possible approaches, both assigning each data stream to a particular link. 
The first method achieves this by numbered switch frames that first have to be exchanged between the 
nodes before the link switching actually can take place. In the second method, the switching is only 
prepared by exchanging special frames. The actual switching takes place by just using an already prepared 
75 link. Both solutions are efficient, flexible, and order presenting, thus achieving the objects of the invention. 

Introduction 

Connecting two adjacent network nodes by more than a single link is an appropriate way of increasing 

20 the communication capacity and reliability between the two nodes. Such a set of parallel links is usually 
called a transmission group, in the prior art, in SNA, for example, the bottom sublayer of the Path Control 
layer (corresponding to OSI layer 3, the network layer) which is called the Transmission Group sublayer, 
combines one or more parallel SDLC (Synchronous Data Link Control) links and makes them appear to 
higher layers as a single link. Consequently the FIFO nature of a single link has to be guaranteed for the 

25 transmission group as a whole by the Transmission Group sublayer. 

In the SNA approach, this is achieved as follows. A sequence number is attached to each frame at the 
sender side. At the receiver side, the frames are ordered according to the sequence numbers. If a frame is 
missing, it is retransmitted over another link until it is successfully transmitted or the maximum retry count 
is reached. Because of the transmission of the same frame on different links in case of transmission errors. 

30 there is the problem that no easy wrap-around of the sequence numbers as in SDLC is possible (sequence 
numbers are in the range from 0 to 4095). SNA solves this problem by quiescing all links of the 
transmission group when the maximum number is reached. The receiver first sends a sequence number 
wrap acknowledgement. The sender then sweeps all links, i.e. makes sure that there are no old frames in 
the links anymore, sends a frame with sequence number 0 and sweeps the links again. More detailed 

35 information on this topic can be found in the textbooks on SNA, cited above, or in other SNA literature. 

The overhead of each frame carrying an additional sequence number, the procedures of frame 
resequencing, retransmission on different links and of the sequence number wrap-around are considerable. 

This invention discloses two more efficient solutions for the transmission of data over transmission 
groups, provided that the assumptions described in the following section hold. 

40 

Assumptions 

The frames to be transmitted over a transmission group can be identified as belonging to different data 
streams and order preservation has to be guaranteed only for each individual data stream, but not globally 

45 for all frames. Such a data stream may be identified by some kind of a connection identifier in the frame or 
by a pair of end points, as for example the pair destination MAC (Medium Access Control) address and 
destination LLC SAP (Logic Link Control, Service Access Point), source MAC address and source LLC SAP 
in case of two LANs being remotely bridged over a transmission group. 

As will be seen below, for each data stream a certain amount of state iriformation has to be 

50 remembered. So, if the granularity of different recognizable data streams is too fine, the amount of state 
information may become very large, in this case, the granularity can be made coarser by grouping several 
data streams together, e.g. by taking into account only the first n most significant bits of a connection 
identifier or. in case of remote bridging, by identifying a data stream only through the pair (destination MAC 
address, source MAC address) disregarding the LLC SAPs. 

55 A possible loss of frames is tolerable. Thus, no retransmission scheme is implemented. The underlying 
assumption is that this is done on an end-to-end basis, e.g. by the LLC in case of remote bridging. Note 
that a protocol that tolerates frame losses is not necessarily also able to deal with frame reordering. LLC 
may be taken as an example. 
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A data stream is completely independent from its corresponding reverse data stream. In the following 
pay load date transmission Is thus considered only for one direction, from a sender to a receiver node. 

General Concept of the Invention 

5 

Because of the first assumption mentioned In the previous section, namely that different data streams 
can be Identified and that it is sufficient to preserve the frame order only for each data stream, a simple 
exploitation of a transmission group is just to distribute the data streams onto the links of the group, 
typically sending more than one data stream over the same link, but never sending a single data stream 

70 over several links (because of order preservation difficulties). What is needed is a simple table that assigns 
a link to each data stream. An obvious disadvantage of this approach is the loss of flexibility as compared to 
the method described for SNA. E.g., if one link is heavily loaded because of a tremendous increase of 
traffic for the data streams assigned to this link while the utilization of other links is rather low, a need arises 
to balance the traffic load within the transmission group. It is thus required to be able to dynamically shift a 

75 data stream, from one link to another one without corrupting the order. This action will be called link 
switching. Here, two methods are described how to achieve such a link switching. 

In both methods, the sender and the receiver store for each data stream the cunrently used link called 
the active link, and a sequence number counting the number of switching requests for this data stream. The 
sender transmits the payload data for a given data stream only on the currently active link and the receiver 

20 accepts frames for a given data stream only from the currently active link. 

In the first solution, explicit switch request frames are sent from the sender to the receiver in order to 
inform the receiver that the active link shall be changed. Switch request frames are always sent over that 
link to which the data stream shall be switched, i.e. they are sent over the 'new' link. On receiving such a 
switch request frame, the receiver changes the active link to that link on which the request frame arrived for 

25 the data stream as indicated in the request. In addition, the receiver replies to such switch requests by 
sending switch responses back also over the 'new' link. The sender then also changes his active link and 
thereafter starts to forward frames for the corresponding data stream on the new link. Because such switch 
request and response frames may be lost or heavily delayed, it may be decided to resend them. The loss 
or delay of switch frames may be taken as an indication that switching to this particular link is not a good 

30 idea. So another link may be selected to switch to. This means that switch request frames are resent, 
possibly over different links. In order to decide at the receiver side which request frame Is the most recent 
one, a sequence number is attached, to each switch frame (as it Is done in SNA for each data frame). The 
receiver only switches the link and sends replies after having received a switch request frame with a 
sequence number higher than the sequence numbers of all previously received frames. This sequence 

35 number is also added to each switch response frame. 

Similarly, the sender only switches to the new link if a switch response is received with the same 
sequence number as the last sent switch request. Note that the sequence numbers are handled on a per 
data stream basis. Note also that frames sent on the old link while the receiver already has switched to the 
new Jink, are simply lost. The assumption Is. however, that such a loss is tolerable. The typical way of using 

40 this method, however. Is to stop transmitting until the switch response has arrived. 

Thus, in the first solution, a switch request and response first have to be exchanged. The second 
solution presented just avoids this delay. Instead of exchanging switch request and response frames, the 
candidate links are swept by exchanging sweep request and response frames. These sweep frames, 
however, do not trigger the change of the active link for a given data stream, but the reception of such a 

46 sweep request and response frame is only taken as an indication by the receiver and the sender, 
respectively, that the given link is clean and a switch to this link is now possible. The actual switching takes 
place by simply using from now on a clean link at the sender side. The receiver switches to the new link 
upon receiving the first frame over a new, clean link. After having switched a link, all links are considered to 
be dirty again. This Is done In the same way at the sender and at the receiver side. As in the previous 

so proposal, sweep requests and responses carry sequence numbers to distinguish old and new sweep 
frames. The sender's sequence number is increased for each switching action done at the sender side, but 
not for each sweeping frame sent! The receiver accepts a sweeping frame arriving over a yet dirty link and 
carrying the current sequence number, i.e. the link is added to the set of clean links at the receiver side. 
Similarly, the sender adds a link to the set of clean links if a sweep response arrives carrying the current 

ss sequence number. This allows that more than one link can be swept and considered clean. There are thus 
several links ready to potentially take over the data stream which is very important in a critical situation. 
Like the sender, the receiver increases its sequence number with each switching action done. If the receiver 
gets a sweep request frame with a sequence number larger than the current one, it notices that one switch 
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was missed. 

Consequently, this case is handled like a switch, i.e. all links are considered dirty except the one for 
which the sweep arrived. Note that the active link does not always have to be clean. The state of a link 
determines whether a data stream can be switched to that link or not. This state, however, has no meaning 
5 for the active link. So, e.g. in the case mentioned above where the receiver notices a missing switch and 
considers all links to be dirty except the one for which the sweep arrived, the active link stays the same and 
the receiver still accepts data frames on this active link until an actual switch takes place, i.e. until a data 
frame arrives on a different, clean link. 

Obviously, in the second solution, a switching can be done immediately if there are clean links 
10 available. This advantage, however, has to be paid by storing for each data stream which link is dirty and 
which one is clean. So there is a clear trade-off between the two solutions. Which method to use can only 
be decided if the requirements for a special application are known. 

It shall be pointed out that there is no method for the wrap-around of the sequence numbers. It is not 
needed because 

75 - the sequence number only counts the switchings per data stream and not globally all individual 
frames, thus its growing Is much smaller, and < because a sequence number is transmitted only in 
switch or sweep frames, 
• it is thus affordable to use as many bits as needed. 

In the following two sections, a detailed description of the methods outlined above is presented with 
20 reference to the drawings. 



The Drawings 

Fig. 1 shows a typical frame with its various sections used in solution I of the invention; 
26 Fig. 2 shows sender and receiver and their connection according to solution I of the present 
invention; 

Fig. 3 shows a typical frame with its various sections used in solutions II of the present invention; 
Fig, 4 shows sender and receiver and their connection according to . solution. 11. of the present 
invention. 
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Detailed Description of Embodiment i 



The complete method is described by two processes, a sender and a receiver process. They interact 
with their local system environment by sending and receiving messages 13, 15, 16, etc. to and from 

35 operating systems channels as depicted in Fig. 2. (For the terminology: "frames" are exchanged between 
the two nodes; "messages" are exchanges within a node to control the processes.) 

Each frame {Fig. 1) exchanged between sender 1 and receiver 2 over the links contains at least three 
components, preferably in three fields of the frame. Rrst, a type-of-frame indicator (type) that determines 
which type of frame it is. Three types exist: DATA frames, containing payload data; SWITCH REQUEST 

40 frames, identifying a request from a sender, explained in detail below; and SWITCH RESPONSE frames, 
identifying a response from a receiver on such a sender request, also explained below in detail. Second, a 
data stream identifier (ds) that identifies the data stream to which the frame belongs. Third, an Information 
part (info) which either contains the payload data if the frame is of the DATA type, or a sequence number if 
the frame is of the SWITCH type. 

45 Sender 1 (Fig. 2) receives messages 3 from the upper layer through the from^upper channel. 
Messages 3 contain a data stream identifier (ds) and the payload (data) to be transmitted. In addition, the 
sender process sends and receives messages 4 to and from the lower layer through the channels to lower 
and from_lower, respectively. These messages contain a link section (link) and a frame (frame) according 
to Fig. 1. The meaning of such a message Is that the frame is to be sent or was received over the given 

50 link. The frame itself carries the type field, indicating whether It is a (pure) data frame or a switch 
request/response frame, the data stream identification and an information field which is interpreted as 
payload for data frames and as a sequence number for switch frames. 

Also, a management process may send switch request messages 5 to the sender process through the 
channel from_mngmnt. These messages 5 simply 

55 contain the data stream identifier (ds) and the new link (link). Whenever a switch has been done 
successfully, this Is reported to the management by messages 6 through the channel to^^mngmnt. 

The interaction of receiver 2 with Its environment is very similar to the sender process with the 
exception that receiver 2 sends messages 7 to the upper layer, via the channel to_upper, Instead of 
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receiving from it. Each message 7 is an equivalent to message 3 that the sender received from the upper 
layer. Also, receiver 2 reports switching actions by messages 8 to the management process (via the 
channel to^management) but does not accept any commands from it. These messages 8 are equivalent to 
the messages 6 on the sender side. 
5 In the following, the relevant control information held at the sender and at the receiver side together with 
its initialization is shown in C syntax: 

typedef struct {LINK active.link; NUMBER soqno} cntrl; 
TO cntrl sendcntrl [MAX.DS] ,recelvecntrl (MAXJXS]; 

init{) 

for{i = 0; i < MAX.DS; i++) 
75 sendcntrl |i j .active^link = ini tin 1^1 ink; 



sendcntrl [ij.seqno = 0; 

receivecntrl [ i] .actlve_link = ini l: in l_link; 
recelvecntrl [ij.seqno = 0; 



20 



The sender and receiver processes are also written in C with the following extensions. 

- SendO and receive() calls are used for sending and receiving to and from the operating systems 
channels. In order to wait for the arrival of a message on more than one channel, the notation 

26 ch = receive(ch1 or ch2 or ... chn, msg); 

is used where ch gives the channel on which the message finally was received. 

- Depending from which channel a message was received, the components may be accessed through 
the component names as introduced in Fig 1. E.g., if the message msg was received from channel 
from_upper. Its components are msg.ds and msg.data, whereas the components of a message msg 

30 received from from_lower are msgJink and msg.frame. 

■ A message to be sent is simply indicated by giving its components enclosed in <...>. 
Note also that there is no timeout and retry built into the code of the sender process in order to protect 
against lost switch request or response frames. This timeout supervision and triggering of retries has to be 
all done by the management process. This simplifies the sender code in a significant way. Here is the 
35 sender process first. 

process sender( } 
forever 

40 I ^ 

received = receive( from_inngmnt or from_upper or ... 

. . . from^lower,msg) ; 

if (received == from_upper) 

// just send the data on the ncllvo. link 

ds = msg.ds; 
info msg.data; 
frame = <DATA,ds,info>; 
link = sendcntrl (ds) .act ivc_l ink ; 
^ send(to_lower,<llnk,frame>) ; 

else if (received == from_mngmnt) 
// initiate outgoing link switching 
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ds = msg.ds; 
sendcntrl[ds] .seqno++; 
seqno = sendcntri (ds ] .seqno; 
frame = <SWITCH.REQ,ds,seqno>; 
newslink = msg.link; 
send(to_lower ,<new_link, frame>) ; 

else lf(received == from_lower) 

// outgoing link switching has hnm done 

newslink = msg.link; 
frame - msg. frame; 
ds = frame.ds; 

if ((frame. type == SWITCH^RES) 

&& (frame. info == recelvecntrl(ds] -seqno)) 
// correct frame type and cor met sequence number 

sendcntrl[ds] .active^llnk = newslink; 
send(to_mngmnt,<ds ,new_l ink>) ; 



And here follows the receiver process, again In C syntax, 
process receiverO 

25 { 

forever 
{ 

receiveC f roro_lower ,msg) ; 
link = msg. link; 
f ramekin = msg. frame; 
30 ds = frame_in.ds; 

if (f ramekin. type == DATA) 

// data has been received -> pass to user if received on 

tho nctive link 

if(link == receivecntrl[ds] .ncL ive_link) 
35 send(to_upper,<ds,frame_iii. i'nfo>); 

else if(frarae_in.type == SWITCILRF.Q) 

// switch incoming active link if correct sequence number 
{ if(f ramekin. info > sendcntri Ids] .seqno) 

.seqno = f rame_in. info; 
.active_link = link; 
TCH^RES ,ds , f rame_in . inf o> ; 



40 receivecntrl [ds 

receivecntrl[ds 



frame_out = <SW 

send(to_lower,<llnk, frame_oiit>) ; 
send( to.mngmnt , <ds , 1 lnk> ) ; 



45 



50 This completes the description of embodiment I. 

Detailed Description of Embodiment II 

In this section, the second solution Is presented (Figs. 3 and 4). The main difference with respect to the 
55 Interaction of the processes with their local system environment is that the messages exchanged with the 
management process now have an additional component or field (cmd/event) indicating whether It has to be 
interpreted as a sweep or switch message. In addition, the types of the frames transmitted over the linlcs are 
now either data frames, or sweep request/sweep response frames Instead of switch frames. 
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Again, the complete method Is described by two processes, a sender and a receiver process. They 
Interact with their local system environment by sending and receiving frames shown in Fig. 3 to and from 
operating systems channels as depicted in Rg. 4. 

Each frame, as shown in Fig. 3. contains at least three components, preferably in three fields of the 

5 frame. Rrst, there is a type-of-frame Indicator (type) that detenfnines which type of frame It is. Three types 
exist: DATA frames, containing payload data; SWEEP REQUEST frames, identifying a particular request 
from a sender, explained in detail below; and SWEEP RESPONSE frames, identifying a response from a 
receiver on such a sender request, also explained below in detail. Second, a data stream identifier (ds) that 
Identifies the data stream to which the frame belongs Third, an information part (info) which either contains 

10 the payload data, if the frame is of the DATA type, or a sequence number, if the frame is of the SWEEP 
type. 

The interaction of the two processes, the sender and the receiver process, with their upper and lower 
layers is exactly the same as described for the first embodiment in connection with Rgs. 1 and 2. with the 
following important exception. As indicated above, the type field of each frame shown in Fig. 3 can have 
76 one of the values DATA. SWEEP_REQ, or SWEEP_RES (instead of DATA, SWITCH__REQ, or 
SWITCH^RES as in embodiment I). The obvious reason for this Is that In the second solution no switch 
requests and responses are exchanged, but sweep requests and responses. As before, data type frames 
carry data in the Info field, and sweep request and response frames carry a sequence number in the info 
field. 

20 Thus, an important difference to the previous embodiment 1 is the interaction of sender 1 1 and receiver 
12 with their management processes. This Is due to the fact that management now can give two different 
commands to the sender process: one (SWEEP) that requests sender 1 1 to sweep a link for a certain data 
stream, and another command (SWITCH) which actually switches a data stream to a new link. For that 
purpose, messages 15 sent from the management process via the from management channel have an 

25 additional command field cmd, namely to distinguish sweep (SWEEP) and switch requests (SWITCH). A 
sweep request triggers the sender to exchange sweep request and response messages with its receiver 
process, whereas the switch request results in a purely local action, namely to use the indicated link for 
future outgoing frames belonging to the indicated data stream (provided the link is clean). Likewise, the 
messages sent from sender 11 and receiver 12 to their management processes also have an additional 

30 event field (EVENT) to indicate if a sweep or a switch has been successfully carried out. 

Sender 11 (Fig. 4) receives messages 13 from the upper layer through the from_upper channel. Each 
message 13 contains a data stream identifier (ds) and the payload (data) to be transmitted. In addition, the 
sender process sends and receives messages 14 to and from the lower layer through the channels 
follower and from^lower, respectively. These messages contain a link section (link) and a frame (frame) 

35 according to Fig. 3. The meaning of such a message is that the frame is to be sent or was received over 
the given link. The frame itself carries the type field, indicating whether it Is a (pure) data frame or a sweep 
request/response frame, the data stream identification and an information field which is interpreted as 
payload for data frames and as a sequence number for sweep frames. 

As already addressed above, a management process may send sweep request messages 15 to the 

40 sender process through the channel from_mngmnt. Other than in the first solution, these messages 15 
contain the data stream identifier (ds), the new link (link), and a command (cmd), indicating, whether a 
switch or sweep is to be made. Whenever a switch or sweep has been done successfully, this is reported to 
the management by a message 16 through the channel to_mngmnt. This message 16 carries an event 
field, the contents of which (either SWEEP or SWITCH) indicates to the sender management that either a 

45 sweep or a switch was carried out. 

The interaction of receiver 12 with its environment is again very similar to the sender process with the 
exception that receiver 12 sends messages 17 to the upper layer, via the channel to_upper, instead of 
receiving from it Each message 17 is an equivalent to message 13 that sender 11 receives from the upper 
layer. Also, receiver 12 reports switching actions by messages 18 to the management process (via the 

50 channel to_management) but does not accept any commands from it. These messages 18 are equivalent 
to the messages 16 on the sender side and carry the respective information (either SWEEP or SWITCH) in 
an event field. 

The control information stored at each side now contains in addition for each data stream the state of 
the links (clean or dirty). This information and Its Initialization is shown below, as usual In C notation. In the 
55 following, the relevant control infomnation held at the sender and at the receiver side together with its 
initialization is shown in C syntax: 
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typedef struct { 
LINK active link; 
NUMBER seqno 

enum {DIRTY, CLEAN) state[MAXJ.INKS) ; 
) cntrl; 

cntrl sendcntrl[MAX_DS] ,receivecntrl IMAX_DS] ; 

initO 
{ 

ford = 0; i < MAX.DS; 



actlve.link = init ial_llnk; 
seqno = 0; 

1] .active_llnk = in i tlal^link; 



75 



sendcntriri 
sendcntrl[l 
receivecntr 

receivecntrl(i] .seqno = 0; 
for(j = 0; j < MAX_LINKS; j++) 

sendcntrl[i] .state[ j] = CLEAN; 
^ receivecntr l[l].state[j] = CLEAN; 



20 



Finally the sender and receiver processes are as follows: 



25 



30 



process senderO 
forever 

{ 

received = receive( from_mngmnt or frora_upper 

or f rom_lower ,msg) ; 
if (received == from^upper) 
// just send the data on the active link 

ds = msg.ds; 
info = msg.data; 
frame = <DATA,ds,info>; 
link = sendcntrl[ds] .active_l ink; 
^ send(to_lower,<link,frame>) ; 

else if (received ~ from_mngmnt) 

// switch to clean link or initiate link sweeping 

40 ^ 
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ifdnsg.cmd == SWITCH) 
( 

link = msg.link; 
ds = msg.ds; 

if(sendcntrl[ds] .state[llnk| == CLEAN) 
I 

sendcntrlfdsl .seqno++; 
sendcntrl[ds) .active_llnk = link; 
for(j = 0; j < MAX.LINKS; j++) 

sendcntrl[ds].state[ jj = DIRTY; 
send(to mngmnt ,<SWITCn ,d.s , 1 ink>) ; 



else if(msg.cmd == SWEEP) 

link = msg. link; 
ds = msg.ds; 

seqno = sendcntrl[ds ] , seqno; 
frame = <SWEEP_REQ,ds ,seqno> ; 
send(to_lower ,<link, frflme>) ; 

^1 

else if (received == from^lqwer) 

// outgoing link sweeping has bo.*»n done 

link = msg.link; 
frame = msg. frame; 
ds = fraroe.ds; 
if(frame.type == SWBEP^RES) 

6c& (frame. info == sendcntrl[ds) .seqno)) 
// correct frame type and corroct sequence number 

^ sendcntrl[ds) .state[link] = CLEAN; 
send(to_mngmnt,<SWEEP,ds, I lnk>); 



rocess receiverO 

forever 

receive(from_lower,msg) ; 

link = msg.link; 

frame = msg. frame; 

ds. = frame = ds; 

if( frame, type == DATA) 

// data has been received . -> pa.ss to user if received on 

thn. active link 

if(link == recelvecntrl[ds J .flcLlve_link) 

send( to.upper , <ds , f rarae . i n f o> ) ; 
else if(receivecntrl[ds] .stflt.ft| link] == CLEAN) 

receivecntrllds] .seqno++; rpr.eivecntrl(ds] .active_link 
link; 

for(j = 0; j < MAX.LINKS; )++) 

receivecntrllds]. sta ten ) = DIRTY; 
send(to mngmnt ,<SWITCH,ds , lmk>) ; 

J J 

else if( frame. type == SWEEP_RKQ) 

// sweep incoming active link if r.orrect sequence number { 
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if(fraroe. Info >= sendcntrl [ds | .seqno) 

lf( frame. info > sendcntrl |ds] .seqno) 

receivecntrl[ds] .seqno = frame. info; 
for(j = 0; j < MAX.LINKS; j++) 

receivecntrl[dsT.state[ j] = DIRTY; 

recelvecntrl[ds] .state[ link) = CLEAN; 
frame = <SWEEP_RES,ds , frame. info>; 
^ send(to_lower,<link, frarae>) ; send(to_mngmnt ,<ds, link>) ; 



75 

To summarize, the disclosed transmission groups are an appropriate way to increase the communication 
capacity and reliability between two network nodes. The requirement of a single link appearance of such a 
group enforces some procedure for preserving the order of the frames. The prior art SNA method is to 
attach a sequence number to each frame and reorder the frames at the other side according to this number. 

20 Under the assumption that several data streams can be Identified, that it is sufficient to guarantee order 
preservation only for each data stream and that frame loss Is tolerable, the new approaches allow a flexible 
and efficient transmission of data streams over transmission groups. Both approaches assign each data 
stream to a lini<. For flexibility reasons, a possibility is added that allows an order preserving shifting of a 
data stream from one link to another one which is called link switching. The first method achieves this by 

25 numbered switch frames that first have to be exchanged between the nodes before the link switching 
actually can take place. In the second, faster method, the switching is only prepared by exchanging special 
frames. The actual switching takes place by just using an already prepared link. So the second method 
allows immediate switching, provided the preparation has been done, but it requires more state information 
for each data stream to be stored. 

30 So a trade-off exists k>etween both methods and depending on the environment, one or the other may 
be preferable. Apart from that, both solutions or .embodiments presented are 

- efficient, because the overhead carried in each frame is zero (the data stream identifier is assumed to 
be there anyway) and because the additional protocol for link switching is simple and requires only a 
very limited amount of frames to be exchanged. 

35 - flexible, because a dynamic change of the assignment of data streams to links is possible by link 
switching, and 

- order preserving as has been shown. 

The invention has been described with reference to two preferred embodiments. It is. however, 
understood that a person skilled In the art may vary and modify details, by using the teachings of this 
40 description, without departing from the spirit and scope of this Invention, as defined in the appended claims. 



Claims 

1. Method for link switching when transmitting a data stream between two nodes (1 and 2, 11 and 12) of a 
45 network such that the order within the data stream is preserved, said two nodes being connected by at 
least two parallel links (link 1 ... link n), of which only one is currently active, the method comprising the 
steps of 

a. generating a switch/sweep request in the sending node (sender 1.11), 

b. attaching a sequence number to said switch/sweep request. 

50 c. transmitting said switch/sweep request with its sequence number from the sender to the receiving 

node (receiver 2, 12) over at least one currently inactive link, 

d. determining. In the receiver (2. 12). whether a received switch/sweep request caries a higher 
sequence number than a switch/sweep request received before and is thus acceptable, 

e. if so, sending to the sender (1. 11) over said currently inactive link a switch/sweep response with 
55 the sequence number of said received switch/sweep request, and 

f. detenfnining. in the sender (1.11). when receiving a switch/sweep response, whether its sequence 
number matches the sequence number sent with the last switch/sweep request and is thus 
acceptable. 
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g. depending on the result of at least one determining step, activating a so far inactive link to 
transmit the data stream. 

2. Method according to claim 1 , wherein 

5 the receiver (2) switches to said currently inactive link upon determining that a received (switch) 
request is acceptable, and 

the sender (1) switches to said currently inactive link upon determining that a received (switch) 
response is acceptable. 

thus effectively switching the data transmission to said new, so far Inactive link. 

10 

3. Method according to claim 2, wherein the sender (1) continues sending data over the currently active 
iink until the sender switches to the currently inactive link. 

4. Method according to claim 2, wherein the sender (1). upon sending the (switch) request over the 
75 currently inactive link, suspends sending data and. upon receiving an acceptable (switch) response. 

resumes sending data over the so far inactive link. 

5. Method according to claim 1 , wherein 

receipt of an acceptable (sweep) request over a currently inactive link by the receiver (12) indicates to 
20 the receiver that this particular link is "clean". 

receipt of an acceptable (sweep) response over a currently inactive link by the sender (11) indicates to 
the sender that this particular link is "clean", 

the sender (11) effectively switches data stream transmission to any one of the so far Inactive links at 
any time after the sender has identified this particular link as "clean", and, 
25 upon receiving data from a "clean", so far inactive link, the receiver (12) effectively switches data 
stream reception to said link. 

upon establishing data stream transmission over said so far inactive link indicating to the sender and to 
the receiver that ail other links are no more "clean". 

Method according to claim 5, wherein 

(sweep) requests and responses (Fig.3) carrying the same sequence number are exchanged over a 
plurality of currently inactive links, and 

each acceptable (sweep) request/response pair is taken as indicator that the particular link over which it 
was exchanged is "clean". 

Method according to claim 6, wherein 

transmission of data is switched by the sender randomly to any one of said "clean", so far inactive 
links. 

40 
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